docs(FR-2603): apply 26.4 model serving doc feedback — service launcher fields, vLLM/SGLang runtime params by agatha197 · Pull Request #6804 · lablup/backend.ai-webui

agatha197 · 2026-04-17T14:03:27Z

Resolves #6803 (FR-2603)

Summary

Addresses additional Sujin feedback on the 26.4 model serving docs, stacked on top of #6778.

Service Launcher fields: Refined descriptions for Service Name, Open To Public, Model Storage Folder to Mount, Inference Runtime Variant, and Environment / Version across en/ja/ko/th.
Runtime parameters: Split into vLLM and SGLang subsections reflecting the new tab-based UI (Model Loading / Resource Memory / Serving Performance / Multimodal / Tool Reasoning). Documented Model Loading tab fields (Model, DType, Quantization, Max Model Length / Context Length, Served Model Name, Trust Remote Code).
Legacy section removal: Removed the <details> block about model service configuration in version 23.03 and earlier. Moved the Custom runtime workflow (model / service definition files) behind a collapsible block below the 26.4 quick-deploy flow so the default path is visible first.
Command mode section: Moved the command-mode screenshot before the field list and consolidated the field bullets (start command, model mount, port auto-detect, health check URL auto-detect, initial delay, max retries).
Port / Health URL / Mount auto-detection: Clarified that these fields are auto-detected from the start command.
Scale Out/In sentence removal: Removed the sentence referencing the explicit Scale Out / Scale In selector, since the step-size column now infers direction automatically.
Drawer error alert rendering fix: Changed *No compatible presets available. This model cannot be deployed.* to **...** so it renders as bold (the original italic was not rendering reliably next to CJK characters).
Screenshots: Refreshed service_launcher1.png and service_launcher_command_mode.png for ko. Added new service_launcher_runtime_params_vllm.png and service_launcher_runtime_params_sglang.png for ko.

Test plan

Render the ko docs locally and verify the drawer error alert in the Model Store section renders as bold (no stray * characters).
Verify the Service Launcher field list and the command-mode subsection show the updated labels and screenshots.
Verify the vLLM and SGLang runtime parameters subsections render with the new per-tab field descriptions and the new screenshots.
Regenerate the ko PDF (pnpm run pdf:ko) and confirm pages 121–122 show the updated vLLM / SGLang runtime parameter images and that 그림 15.6 shows the updated service launcher view.

Copilot

Pull request overview

Updates the Backend.AI WebUI user manual (Model Serving) to reflect the 26.4 Service Launcher UI changes, including revised field descriptions and the new tab-based runtime parameters for vLLM and SGLang, with corresponding screenshot updates.

Changes:

Reworked the “steps/workflow” section to emphasize 26.4 quick deploy + Service Launcher, and moved Custom runtime file-based workflow into a collapsible “Advanced” block.
Updated Service Launcher field descriptions and the command-mode field list (auto-detected Port/Health URL/Mount, plus retry/delay fields).
Split runtime parameters into vLLM vs SGLang subsections and added/updated screenshots (notably in ko).

Reviewed changes

Copilot reviewed 4 out of 8 changed files in this pull request and generated 13 comments.

Show a summary per file

File	Description
packages/backend.ai-webui-docs/src/en/model_serving/model_serving.md	Reorganized workflow/advanced section; updated launcher fields and runtime parameter docs (vLLM/SGLang).
packages/backend.ai-webui-docs/src/ja/model_serving/model_serving.md	Japanese translation updates aligned to the new launcher/runtime-params UI structure.
packages/backend.ai-webui-docs/src/ko/model_serving/model_serving.md	Korean updates for launcher fields/runtime params; also adjusts Model Store error emphasis.
packages/backend.ai-webui-docs/src/th/model_serving/model_serving.md	Thai translation updates aligned to the new launcher/runtime-params UI structure.
packages/backend.ai-webui-docs/src/ko/images/service_launcher_command_mode.png	Updated Service Launcher command-mode screenshot asset.

agatha197 · 2026-04-21T10:25:04Z

docs(FR-2624): translate remaining English headings in ja and th docs #6846
docs(FR-2623): reorganize admin model serving docs and remove clone references #6844
docs(FR-2603): add health check SVG diagrams for all 4 languages, replace ASCII art #6839
docs(FR-2603): update auto scaling V2 screenshots, fix bold rendering, correct health check initial status, revise condition/cooldown terminology #6807
docs(FR-2603): apply 26.4 model serving doc feedback — service launcher fields, vLLM/SGLang runtime params #6804 👈 (View in Graphite)
docs(FR-2571): address 26.4 docs feedback — remove legacy model serving sections and apply KO wording fixes #6778
docs: add endpoint detail page revision info, alert banners, and edit behavior docs #6767
docs(FR-2571): document Model Store V2 and Auto Scaling Rules V2 (26.4.0+) #6760
docs(FR-2571): address PR #6631 review feedback (excl. model store) #6708
docs(FR-2571): add Allowed Client IPs field to My Account dialog documentation #6631 : 1 other dependent PR (#6633 )
docs(FR-2570): recapture login screenshots with TOTP OTP screen in light mode #6630
docs(FR-2569): recapture start_announcement_banner in light mode #6625
docs(FR-2543): update model serving documentation with new features #6611
docs(FR-2542): update date selection UI in statistics documentation #6580
docs(FR-2541): fix permission label formatting in vfolder documentation #6579
docs(FR-2540): fix session type filters in session_page documentation #6578
docs(FR-2539): update copy button location in my_environments documentation #6577
docs(FR-2538): fix button labels in import_run documentation #6576
docs(FR-2537): add board customization and auto-refresh to dashboard docs #6575
main

How to use the Graphite Merge Queue

Add either label to this PR to merge it via the merge queue:

flow:merge-queue - adds this PR to the back of the merge queue
flow:hotfix - for urgent changes, fast-track this PR to the front of the merge queue

You must have a Graphite account in order to use the merge queue. Sign up using this link.

_{An organization admin has required the Graphite Merge Queue in this repository.} _{Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.}

This stack of pull requests is managed by Graphite. Learn more about stacking.

graphite-app · 2026-04-22T03:32:58Z

Merge activity

Apr 22, 3:32 AM UTC: ironAiken2 added this pull request to the Graphite merge queue.
Apr 22, 3:42 AM UTC: Merged by the Graphite merge queue.

…er fields, vLLM/SGLang runtime params (#6804) Resolves #6803 ([FR-2603](https://lablup.atlassian.net/browse/FR-2603)) ## Summary Addresses additional Sujin feedback on the 26.4 model serving docs, stacked on top of #6778. - **Service Launcher fields**: Refined descriptions for Service Name, Open To Public, Model Storage Folder to Mount, Inference Runtime Variant, and Environment / Version across en/ja/ko/th. - **Runtime parameters**: Split into vLLM and SGLang subsections reflecting the new tab-based UI (Model Loading / Resource Memory / Serving Performance / Multimodal / Tool Reasoning). Documented Model Loading tab fields (Model, DType, Quantization, Max Model Length / Context Length, Served Model Name, Trust Remote Code). - **Legacy section removal**: Removed the `<details>` block about model service configuration in version 23.03 and earlier. Moved the Custom runtime workflow (model / service definition files) behind a collapsible block below the 26.4 quick-deploy flow so the default path is visible first. - **Command mode section**: Moved the command-mode screenshot before the field list and consolidated the field bullets (start command, model mount, port auto-detect, health check URL auto-detect, initial delay, max retries). - **Port / Health URL / Mount auto-detection**: Clarified that these fields are auto-detected from the start command. - **Scale Out/In sentence removal**: Removed the sentence referencing the explicit Scale Out / Scale In selector, since the step-size column now infers direction automatically. - **Drawer error alert rendering fix**: Changed `*No compatible presets available. This model cannot be deployed.*` to `**...**` so it renders as bold (the original italic was not rendering reliably next to CJK characters). - **Screenshots**: Refreshed `service_launcher1.png` and `service_launcher_command_mode.png` for ko. Added new `service_launcher_runtime_params_vllm.png` and `service_launcher_runtime_params_sglang.png` for ko. ## Test plan - [ ] Render the ko docs locally and verify the drawer error alert in the Model Store section renders as bold (no stray `*` characters). - [ ] Verify the Service Launcher field list and the command-mode subsection show the updated labels and screenshots. - [ ] Verify the vLLM and SGLang runtime parameters subsections render with the new per-tab field descriptions and the new screenshots. - [ ] Regenerate the ko PDF (`pnpm run pdf:ko`) and confirm pages 121–122 show the updated vLLM / SGLang runtime parameter images and that 그림 15.6 shows the updated service launcher view. [FR-2603]: https://lablup.atlassian.net/browse/FR-2603?atlOrigin=eyJpIjoiNWRkNTljNzYxNjVmNDY3MDlhMDU5Y2ZhYzA5YTRkZjUiLCJwIjoiZ2l0aHViLWNvbS1KU1cifQ

Copilot AI review requested due to automatic review settings April 17, 2026 14:03

github-actions Bot assigned agatha197 Apr 17, 2026

github-actions Bot added the size:XL 500~ LoC label Apr 17, 2026

Copilot started reviewing on behalf of agatha197 April 17, 2026 14:03 View session

Copilot AI reviewed Apr 17, 2026

View reviewed changes

agatha197 force-pushed the docs/FR-2603-apply-26.4-model-serving-doc-feedback branch from c09fb2d to b47daaf Compare April 18, 2026 01:35

agatha197 force-pushed the 04-17-docs_fr-2571_address_26.4_docs_feedback_remove_legacy_model_serving_sections_and_apply_ko_wording_fixes branch from 99d511b to 62feb55 Compare April 21, 2026 10:23

agatha197 force-pushed the docs/FR-2603-apply-26.4-model-serving-doc-feedback branch from b47daaf to 467ad1b Compare April 21, 2026 10:23

yomybaby mentioned this pull request Apr 21, 2026

docs(FR-2571): address 26.4 docs feedback — remove legacy model serving sections and apply KO wording fixes #6778

Merged

5 tasks

This was referenced Apr 21, 2026

docs(FR-2603): update auto scaling V2 screenshots, fix bold rendering, correct health check initial status, revise condition/cooldown terminology #6807

Merged

docs(FR-2603): add health check SVG diagrams for all 4 languages, replace ASCII art #6839

Merged

agatha197 force-pushed the 04-17-docs_fr-2571_address_26.4_docs_feedback_remove_legacy_model_serving_sections_and_apply_ko_wording_fixes branch from 62feb55 to a914365 Compare April 21, 2026 11:07

agatha197 force-pushed the docs/FR-2603-apply-26.4-model-serving-doc-feedback branch 2 times, most recently from 3d3f3cc to ba280f4 Compare April 21, 2026 11:13

This was referenced Apr 21, 2026

docs(FR-2623): reorganize admin model serving docs and remove clone references #6844

Merged

docs(FR-2624): translate remaining English headings in ja and th docs #6846

Merged

ironAiken2 force-pushed the 04-17-docs_fr-2571_address_26.4_docs_feedback_remove_legacy_model_serving_sections_and_apply_ko_wording_fixes branch from a914365 to c6299cd Compare April 22, 2026 03:31

ironAiken2 force-pushed the docs/FR-2603-apply-26.4-model-serving-doc-feedback branch from ba280f4 to 0a4e280 Compare April 22, 2026 03:31

graphite-app Bot force-pushed the 04-17-docs_fr-2571_address_26.4_docs_feedback_remove_legacy_model_serving_sections_and_apply_ko_wording_fixes branch from c6299cd to e667f94 Compare April 22, 2026 03:35

graphite-app Bot force-pushed the docs/FR-2603-apply-26.4-model-serving-doc-feedback branch from 0a4e280 to 57fb0cc Compare April 22, 2026 03:36

Base automatically changed from 04-17-docs_fr-2571_address_26.4_docs_feedback_remove_legacy_model_serving_sections_and_apply_ko_wording_fixes to main April 22, 2026 03:41

graphite-app Bot merged commit 57fb0cc into main Apr 22, 2026
4 checks passed

graphite-app Bot deleted the docs/FR-2603-apply-26.4-model-serving-doc-feedback branch April 22, 2026 03:42

github-pages Bot temporarily deployed to github-pages April 22, 2026 03:43 Inactive

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

docs(FR-2603): apply 26.4 model serving doc feedback — service launcher fields, vLLM/SGLang runtime params#6804

docs(FR-2603): apply 26.4 model serving doc feedback — service launcher fields, vLLM/SGLang runtime params#6804
graphite-app[bot] merged 1 commit intomainfrom
docs/FR-2603-apply-26.4-model-serving-doc-feedback

agatha197 commented Apr 17, 2026 •

edited by atlassian Bot

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

agatha197 commented Apr 21, 2026 •

edited

Loading

Uh oh!

graphite-app Bot commented Apr 22, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

agatha197 commented Apr 17, 2026 • edited by atlassian Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Test plan

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

agatha197 commented Apr 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

How to use the Graphite Merge Queue

Uh oh!

graphite-app Bot commented Apr 22, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merge activity

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

agatha197 commented Apr 17, 2026 •

edited by atlassian Bot

Loading

agatha197 commented Apr 21, 2026 •

edited

Loading

graphite-app Bot commented Apr 22, 2026 •

edited

Loading